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(57) Tone dependent plane dependent error diffusion 
halftoning takes into account multiple color planes, such 
as cyan and magenta, when determining the placement of 
3 dot In any of the color plandS- The combined tone* of 
the correlated color planes is used to determine the 
threshold levels (64) against which the combined tones 
and the accumulated errors for the correlated color planes 
is compared. Further, tone dependent error weightings 
are determined based on the combinod tones of the 
correlated color planes (64). The tone dependent error 
weightings are used to diffuse the final accumulated 
errors for each color plane <72). A prerendered mid-tone 
bitmap may be used to break up any structured panerns 
that occur in the mid-tones* Using this technique, printed 
dots of two or more colors are dispersed so as to avoid 
noticeable clumping of dots of two or more colors to 
provide a more uniform pattern and to avoid the 
unintentional overlapping of colors. This technique can 
be used to augment any existing error diffusion method. 
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TONE DEPENDENT PLANE DEPENDENT 
ERROR DIFFUSION HALFTONING 



FIELD OF THE INVENTION 
The present invention relates to a technique for color image processing and. more 
particularly, to error diffijsion halftoning which correlates dots printed from different color 
planes and tones to create a more visually pleasing combination of different color dots and 
superior dot placement 



BACKGROUND 

Images, such as charts, drawings, and pictures, may be represented as a two- 
dimensional matrix of picture elements (pixels). The spatial resoktion and tone level for 
each pixel are chosen to correspond to the particular output device used. For example, 
typical computer monitors display images at 75 dots per inch (DPI) and have 256 levels of 
intensity for each color. Such monitors use the additive primaiy colors, red, green, and 
blue (RGB), which can be combined to produce millions of colors and also black. 

Typical hardcopy ou^ut devices, such as Inkjet printers, are binary devices, 
meaning that for each pixel or possible dot location on the printed medium they can only 
20 print at two levels: on or off. Therefore, some means must be provided to convert the 
monitor-based version of the image (256 tone levels per color), or another version of the 
color image, to the binary version (2 levels per color). These conversion methods are 
commonly referred to as halftoning. Halftoning methods are described in the book Digital 
Halftoning, by Robert Ulichney, The MIT Press, 1987, incorporated herein by reference. 

One major approach to halftoning is error diffiision. The decision about whether or 
not to print a dot is based not only on the "ideal" intensity (i.e., one of the 256 possible 
intensities) for that pixel, but on what has happened before for previously processed pixels. 

It is assumed in the following explanation that there are 256 pixel intensities that 
range between 0 and 255. In conventional error diffusion, at ^ch point where a dot may 
30 be printed, the original image pixel intensity between 0 to 255, plus accumulated enror, is 
compared to a iweviously chosen threshold value. If the image pixel intensity is greater 
than the threshold value, a dot (255 intensity) is assigned to that pixel. If not, no dot (0 
intensity) is assigned, hi eitiier case, the intensity difference between the actual dot value 
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assigned (0 or 255) and the ideal image pixel intensity plus accumulated error for that 
point is derived, and this difference becomes an error tenn that is "diffused" to other 
subsequently processed pixels. In other words, the diffused error term is added to the 
image pixel intensity plus the accumulated eiror of other subsequently processed pixels, 
5 and this total resultant image pixel intensity is then compared against the error diffusion 
threshold to determine whether a dot should be printed. The parameters in error diffiision 
halftoning that have the most visual effects on the final outcome of the printed output are 
the thresholds, the error weightings and the direction of the error diffusion. 

Typically, an error diffbsion threshold value is static, e.g., 50 percent of the 
1 0 maximum theoretical image pixel intensity. For example, if there are 256 tone levek (0 to 
255) per pixel, a level of 128 may be chosen as the threshold value. Improvements to the 
quality of the printed output may be achieved, however, by randomly varying the threshold 
value as described in Digital Halftoning, by Robert Ulicbney. The MIT Press, 1987, page 
265. 

1 5 In addition, typical error diffusion techniques use constant weighting factors to 

compute the proportion of the enror that is diffiised to each surrounding pixel. A well 
known error diffusion technique is described by R. Royd and L. Steinberg in the paper 
Adj?>tive Algorithm for Spatial Grey Scale, SID Int'l. Sym. Digest of Tech. Papers, pp. 36- 
37 (1975), incorporated herein by reference. The Floyd and Steinberg error diffiision 

20 technique diffuses the error into a set of four surrounding pixels. Error diffiision with 
higher than four terms can also be used. U.S. Patent 5,313,287 to David Barton, assigned 
to the present assignee and incorporated herein by reference, discloses another error 
diffusion technique. 

Another type of error diffusion method, known as tone dependent error diffusion, 
25 varies the error diffusion threshold value and/or the error weightings according to the tone 
or intensity of the pixel being processed. Tone dependent error diffusion is described in 
the articles "Reduction of Artifacts in Error Diffusion by Means of Input-Dependent 
Weights," by Eschbach. Journal of Electronic Imaging, vol. 2(4), October 1993, and 
"Adaptive Filtering for Error Diffusion Quality Improvement," by Shu, J., SID Digest of 
30 Technical Papers. May 1995, as weU as U.S. Patent Nos. 5,737,453 and 5,757,976, all of 
which are incorporated herein by reference. Tone dependent error diffusion techniques are 
typically monochromatic. 
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Wh=n p-tating a color image, dot. for multipU colors, ^ch ^ cya.^ magcnla, »,d 
,e,,ow are printedtavariouscombinaUoi^to achieve me desired color ,on=s,or^r«l«c 

,h. original color image. Many k.o«, error diffeion meftods operate on one color plane 
(eg c«,.magen.a.oryellow)at».ime. Tl^e types oferrordiftsion methods strive to 
s gene'r^e . visually pleasing pattern of dots (i.e.. dispersed dots) for each separate color, 
independent of the pa.«m of dots for flhe remaining colo... D»e to ratKlom chance, these 
overlapping color dot patterns inevitably restit in two or more dots of different color, 
overtiming or being adjacem to one ^.other. as shown in Fig. 1 . v,hich is perceived by the 

human eye as a clumping of dots. 
^0 Hg. 1 illustrat^sanexampleofapriorartmulti-coloreddotpattemusingmagenta 

dots 4 and cyan dots 6. The overall tone is light blue. When the cyan and magenta planes 
overlap, non-pleasing dot patterns due to adjacent cyan and magenta dots (such as at 
location 7) can be fbraied due to random chance. 

Other knovm enor diffusion methods operate on multiple color planes at the same 
, 5 time, which is known as plane dependency, such as the method described in U.S. 

application serial no. 08/880,475, entitled "CorrelatinB Cyan and Magenta Planes for Error 
Difiusion Halftoning" by Jay S. Gondek, filed June 3. 1997. having the same assignee, and 
which is incorporated herein by reference. Multiple color planes, such as cyan and 
magenta, are conelated to create dot patterns that do not fall on top of one another up to a 
20 combined 100 percent fill. ConsequenUy, the occurrence of darker "blue" dots (cyan 
overlapping magenta creates dark blue) is avoided, which also fills in white space that 
would otherwise contributed to the perception of graioiness. Thus, a more visually 
pleasing patterning of dots is created. 

Fig. 2 illustrates an example of a dot pattern of cyan and magenta dots printed 
25 using a plane dependent error diffusion method As can be seen, Fig. 2 is an improvement 
over Fig. I because there are no adjacent or overlapping cyan and magenta dots. 

However, as can be seen in Fig. 2, a drawback of plane dependent halftoning is that 
the relative spatial placement of the dots in ligjit tones is not optimized. ConsequenUy. in 
light or mid tones, patterns can develop in the printed output. Tliese patterns occur 
30 because of the way the error can "cascade" through the image to produce curved lines of 
printed dots. These anomaUes are often referred to as ' Vorms" because they can resemble 
small thin worms in the image. 
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As discussed above, while tone dependent error diffusion may be used to generate 
a pleasmg pattern of dots, tone dependent error diffusion is monochromatic. 
Consequently, the use of tone dependent error diffusion with a color image results in an 
image that, while each color may independently have a pleasing pattern, when combined 
5 the colors randomly overlap. 

Accordingly, there is a need for a color halftoning method that provides a printed 
output vsdth the plurality of colors that are correlated so as to produce imiforai patterning 
without imimentionally overlap of the colors. 

10 SUMMARY 

The present invention provides a method and a system for processing an image 
composed of image pixels, each image pixel having a predetemiined tone level. The 
method uses tone dependent plane dependent error diffusion halftoning to process the 
image for output on a digital output device, such as a printer. Tone dependent plane 

15 dependent error difiusion halftoning takes into account multiple color p^es, such as cyan 
and magenta, when determining the placement of a dot in any of the color planes. The 
combined tone of the correlated color planes is used to determine the threshold levels 
against which the combined tone and the accumulated errors for the correlated color planes 
are compared- Further, tone dependent error weightings are determined based on the 

20 combined tones of the correlated color planes. The tone dependent error weightings are 
used to diffuse the final accumulated errors for each color plane. Using this technique, 
printed dots of two or more colors are dispersed so as to avoid noticeable clumping of dots 
to provide a more uniform pattern and to avoid the unintentional overlapping of colors. 
The method determines whether to print zero dots, one dot of either correlated 

25 color plane, or two dots, for each pixel position. Two dots are printed if (1) the combined 
tones from the plane dependent colors are above a full intensity threshold (100 percent 
fill), i.e*, the pixel has a tone value indicating that a dot must be printed; and (2) the 
combined tones and accumulated errors from the plane dependent colors are greater than a 
tone dependent threshold. The two dots that are printed are preferably not of the same 

30 color. One dot is printed if either (1) or (2) is true and no dots are printed if neither (1) nor 
(2) is true. Because the color planes are correlated, the printing of dots of the coirelated 
colors has a reduced likelihood that the printed dots will unintentionally overlap. 
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Thus, the error diffusion takes into account the tone level of the pixel as well as 
multiple color planes when determining whether to print zero, one, or two dots to represent 
the pixel. This technique can be used to augment most existing error diffiision methods. 
In the preferred method, only correlation between the magenta and cyan color planes is 
5 performed, and no correlation with the yellow plane is perfoimed. This is because the 
cyan and magenta planes are darker than the yellow, and adjacent or overlapping cyan and 
magenta dots are much more noticeable than a cyan or magenta dot adjacent to a yellow 
dot. However, correlation with three or more color planes may be performed using the 
techniques described hereiiL 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 illustrates a prior art dot pattern representing an arrangement of cyan and 
magenta dots. 

Fig. 2 illustrates a dot pattern representing a plane dependent halftoning 
1 5 arrangement of cyan and magenta dots. 

Fig. 3 illustrates a color Inkjet printer which includes processing chrcuitry for 
perfoiming all or part of the preferred error diSusion method. 

Fig. 4 illustrates a computer connected to an Inkjet printer, where the computer or 
the printer or both carry out the error diffusion method in accordance with the present 
20 invention. 

Fig* 5 illustrates the general method performed by the computer and printer of Fig. 

4. 

Fig. 6 illustrates a 3x3 block of pixels and their tone values to be reproduced by 
halftoning. 

25 Fig. 7 illustrates the 3x3 block of pixels in Fig. 6 but identifying the intensities of 

the cyan component of the tone values. 

Fig. 8 illustrates the 3x3 block of pixels in Fig, 6 but identifying the intensities of 
the magenta component of the tone values. 

Figs. 9 and 10 show a flow chart which describes a tone dependent plane 
30 dependent error diffusion halftomng method performed by a computer, a printer, or a 
combination of both, in accordance with the present invention. 
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Fig. ] 1 illustrates dot positions and the portions of error diffused to adjacent dot 
positions, 

Fig. 12 is similar to Fig. 1 0 and shows another embodiment of tone dependent 
plane dependent error diffiision halftoning in which a prerendered mid-tone bitmap is used 
5 to avoid visual artifacts in the mid-tone range. 

Fig. 1 3 is a graphical representation of one embodiment of a prerendered mid-tone 
bitmap that may be used in the method of Fig. 12, 

Fig. 14 is an example of a dot pattern of cyan and magenta dots printed using the 
error diffusion method of the present invention to be contrasted with the dot panems in 
1 0 Figs, 1 and 2 for generating the same light blue tone value. 



15 



20 



25 



30 



DETAILED DESCRIPTION 



Fig. 3 illustrates one type of color inkjet printer 10 which includes processing 
circuitry for performing all or part of the error diffusion method described herein. The 
color inkjet printer includes a cover 1 1 , a paper tray 12 for holding virgin paper 14, an 
output tray 15 for receiving the printed pages, color print cartridges 16, and a scaiming 
carriage 18 for sliding along a slide bar 20 while dots are being printed on the paper. The 
color print cartridges 16 include a multiple number of inks, for example cyan (C), magenta 
(M), yellow (Y), and black (K) ink, 

Fig» 4 is a schematic diagram of a printing system which includes a host computer 
22, a monitor 23 (e.g., a CRT), and a printer 24. Printer 24 is a type of color inkjet printer 
which uses a tri-color (CMY) inkjet print cartridge 25, or a number of separate color inkjet 
print cartridges, along with a black inkjet print cartridge 26 in a scanning carriage. Printer 
10 in Fig- 3 may instead be connected to computer 22. Printer 24 includes a printer 
controller 28 for controlling the printing of dots by print cartridges 25 and 26, The print 
cartridges may print at 300 dots-per-inch (DPI), 600 DPI, or any other resolution. 

Fig. 5 illustrates the standard flow of image information from computer 22 to 
printer 24. An image is first created or introduced into the memory of computer 22. In 
oixier to be displayed on the computer monitor 23, this image is represented in additive 
RGB color space. Each pixel location on the screen can be illuminated in red, green, and 
blue at any one of 256 (0 to 255) levels of intensity or tones. It takes 8 bits to represent 
256 levels (2^ = 256). Each of the three primary colors require 8 bits; therefore, RGB 
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color monitors are commonly referred to as producing 24-bit color (3 X S = 24). This 
ixnage is represented at the spatial resolution of the particular monitor. Typical momtors 
have 75 pixels per linear inch (75 DPI) in the vertical and horizontal directions. 

At step 30. the 24-bit RGB color image is held in the memory of computer 22 so 

5 that it can be displayed on monitor 23 . 

At step 32, the image in memory is converted to a 24-bit RGB image at the 
resolution of the printer. Typical Inkjet printers have a resolution of 300. 600 or 1200 dots 
per inch. Although the printer typically prints in CMY or CMYK subtractive colors, it is 
nevertheless convenient for image processing purposes at step 32 to consider the printer to 
be an ROB device. Tins is because later translating the color monitor RGB values directly 
to CMY will usually produce a colorimetric match. However, not all of the matching 
values will produce the same image quality. Some choices will contain more visual noise 
than others, while other choices may lead to undesirable discontinuities in the halftone 

transitions of an image. 

At step 34. the printer RGB color image is converted into CMY color space using a 
look-up table or other conventional means of conversion. Of course, the RGB color image 
may be converted to CMYK color space in a similar manner. 

In step 36. the CMY image Is halftoned to convert the image from 3-plane (CMY), 
8-bit8 per color to 3-plane binary color (on or off dots) at the DPI resolution of the printer. 
In other words, the color and tone (0 to 255) at each pixel location is converted into a 
pattern of on or off C, M. or Y dots (0 or 255 intensity) to be printed. This halftoned 
image (which may be a portion of the total image) is stored in a memory. Step 36 is 
described in greater detail later. 

At step 38, the halftone image is transmitted to the printer, typically using efficient 
communication techniques such as using escape sequences like those identified in 
Hewlett-Packard Company's Printer Control Language (PCL). The image produced at 
step 36 includes all of fte information about how many dots of each color are to be printed 
at each pixel location on the page and the locations of the dots. The printer controller 28 
(Fig. 4) decides when tiiese dots should be printed (i.e., in a single pass or in multiple 
passes). Because of the nature of inkjet printing, it is often beneficial to lay down dots in 
more than a single pass and to prim individual passes in some kind of checkerboard or 
other sparse pattern. It is also beneficial to overiap passes with these interstitial paneras to 
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hide artifacts that may occur betw^een swaths. These procedures for deteimining in what 
pass and in what pattern the dots will be laid down are referred to as "print modes." 

The halftoning step 36 is now described in detail with reference to the remaining 
figures. Thus, it is assumed that step 34 of Fig. 5 has been completed, and the step of 
5 halftoning must now be perfonned. 

It will be understood that, depending on the printer, the functions discussed in 
relation to Fig. 5 can be perfonned by the host computer (programmed to cany out the 
processing functions) or by the printer. For example, in a '"smart" printer, steps 32 through 
38 could ail be performed in the printer. On the other hand, to save memory costs in the 

10 printer, all or part of the functions 32 through 38 could be perfonned in the host computer. 

Prior to the halftoning step, it is assumed that a separate image representation for 
the full color image is stored in a plane for each of the primary colors (C, M, or Y) to be 
printed. This is described with respect to Figs. 6 to 8, 

Fig. 6 illustrates a 3x3 block of pixels 40 in a full color image at the resolution of 

15 the computer monitor. Each of the pixels has a color intensity perceived as light blue 
(LB). The following assumes a range of tones per pixel from 0 to 255 to convey the full 
range of color intensities. Figs. 7 and 8 illustrate the same 3x3 pixel block in Fig. 6 but 
show the cyan tone (Fig. 7) as 44 (out of 255) in each pixel region and the magenta tone 
(Fig. 8) as 33 in each pixel region needed to create an overall light blue intensity. The 

20 combination of the cyan and magenta tones in the two planes will produce the final desired 
color tone. The cyan and magenta tones are proportional to the number of dots in an area, 
where the intensity 255 is a complete fill of that area with cyan or magenta dots. The 
actual number of dot$ per original pixel location depends on the resolution (pixel density) 
of the original image and the resolution (dots per inch) of the pninter. 

25 Enor diSusion attempts to recognize that for each point representing a potential 

dot position, there is usually a difference between what the hardcopy output device will 
print (e.g^ a 0 or 255 tone cyan dot) and the actual image pixel tone (e.g., a 44 tone cyan 
dot). The only time there is no such error is if the image pixel tone is exactly 255 (a dot 
should be printed) or 0 (no dot should be printed). However, such circumstances are rare, 

30 Consequently, there is usually an error. If a dot is printed and the tone level is less than 
255, the error is positive (i.e«, more tone level has been printed than was actually called for 
by the image pixel). If no dot is printed and the image pixel tone is greater than zero, the 
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error is negative (i.e.. less tone level has been printed than was called for by the image 
pixel). Bnor diffusion attempts to spread this error to neighboring pixels. 

The below example assumes that the light blue tone of Fig. 6 to be reproduced 
requires a combination of cyan and magenta dots, with the cyan and magenta tones shown 
5 in Figs. 7 and S. A different tone may also require the use of yellow dots or black dots in 
combination with the cj^ and magenta dots. 

The present method permits both cyan and magenta to be printed for each pixel 
being processed. Instead of a standard error diffusion technique evaluating whether to 
print a cyan dot based upon the accumulated error from printing previous cyan dots, the 
10 preferred error diffusion method determines whether no dot, a single dot of either cyan or 
magenta» or two dots consisting of both cyan and magenta should be printed based upon 
the combined error of the previous cyan and magenta dots. The present method involves 
deteimining both optimum thresholds and error weights based on the tone levels of the 
colors in each pixel. In one embodiment, a pre-rendeied mid-tone bitenap is used to avoid 
15 noticeable structured patterns that may occur in the mid-tones. If used, the pre-rendered 
bitmap is linked to the tone dependent threshold values as will be described in more detail 
below. 

The optimum tone dependent error diffiision thresholds and error weights may be 
deteraiined manuaUy by printing sets of patches for each tone over different parameter 
20 ranges and choosing the patch and corresponding parameters that appear the most visually 
pleasing. Other methods of generating tone dependent thresholds and earor weights may 
be utilized as desired. 

The present invention uses the combination of tone dependency and plane 
dependency to print no dots, one dot, or two dots for each pixel. Two dots are printed if 
25 (1) the combined tones from the plane dependent colors are above a full intensity 

threshold, i.e.. 100 percent fiU threshold; and (2) the combined tones and accumulated 
errors from the plane dependent colors are greater than a tone dependert threshold. The 
two dots that are printed are preferably not of the same color. Thus, for example, a cyan 
dot may be printed followed by a magenta dot (or vice versa) to form a dark blue dot. One 
30 dot is printed if either (1 ) or (2) is true and no dots are printed if neither ( 1 ) nor (2) are 
true. Using tone dependent error weightings, the accumulated errors for the plane 
dQjendent color are then dispersed. 
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Figs- 9 and 1 0 form a flowchart illustrating the basic steps in the tone dependent 
plane dependent error diffusion halftoning method in accordance with one embodiment of 
the present invention. 

As shown in Fig. 9, the converted CMY image from step 34 is received by steps 

5 50, 5 1 , and 52. In steps 50, 51 , and 52, the tone levels for the different colors are 
identified for the particular pixel being processed, e.g., the cyan, magenta, and yellow 
tones are determined. Steps 50 to 52 may be performed in parallel using conventional 
techniques. For example, the 8-bit RGB intensities for pixel being processed may be 
cross-referenced to the 0 to 255 tone levels for the CMY color planes using a look-up table 

10 or other conventional means. The steps for determining the CMY tones may be perfomaed 
as part of step 34 in Fig. 5- 

In step 54, which may also be performed in parallel with steps 50 to 52, the tone 
levels for the dependent color planes are smnmed. Thus, where the cyan and magenta 
planes are to be dependent, an input sum (c+m) of cyan and magenta tone levels is 

1 5 generated. Because the input sum (crhn) is obtained by adding the individual c and m 
tones, each of which ranges from 0 to 255, the range of the input sum (c+m) is 0 to 5 1 0. 

In step 56, it is detemiined whether the input sum (c+m) for the pixel being 
processed is less than a 100 percent fill threshold, i.e., 255, which is the full intensity 
threshold* A pixel is 100 percent fiiH, i.e., a dot will be printed for the pixel, wiien the 

20 pixel has a tone value of 255 or greater. Thtw, if the input sum (c+m) is the fiill intensity 
threshold (255) or greater, a decision is made to print a dot of one of the plane dependent 
colors and the process flows to step 58. 

In step 58, it is detemiined whether a cyan dot or a magenta dot should be printed 
by comparing the current total values for cyan and magenta, where the current total value 

25 for a color is the sum of the tone level and all the accumulated errors for that color at the 
pixel beiiig processed. If the current total value for cyan (c+ce) is greater than or equal to 
the current total value for magenta (m+me), where ce and me are the respective 
accumulated errors for cyan and magenta from previously processed pixels, then a cyan 
dot is printed in step 60- The error, however, is not diffused at this point. Instead, because 

30 a cyan dot is printed in step 60, a modified accumulated error (ce') is generated as equal to 
the previous accumulated error (ce) minus 255, Because a magenta dot was not printed in 
step 60, the modified accumulated error for magenta (me*) is the same as the previous 
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accumulated error (me). A fired flag is set equal to 1 , indicating that a first dot has been 

printed for the pixel. 

On the other hand, if the total value for cyan (c+ce) is less than the total value for 
magenta (m+me). a magenta dot will be printed in step 62. Because a magenta dot is fired 
5 in step 62, a modified accumulated etror (me') is produced for magenta as equal to the 
previous accumulated error (me) minus 255, Because a cyan dot was not printed in step 
62, the modified accumulated error for cyan (ce') is equal to the previous accumulated 
error (ce). Again the fired flag is set equal to 1 indicating that a dot has been printed. 
Whether a cyan dot was printed in step 60 or a magenta dot was printed in step 62, the 
1 0 processing then flows to step 64 in Fig. 1 0. 

If, in step 56, the input sum (c+m) is less than the 100 percent fill threshold (255), 
a decision is made not to print a dot at this point in the process. Because a dot has not 
been fired, in step 57 the fired flag is set to 0 and the modified accumulated errors for 
magenta (me') and cyan (ce') are defmed as equal to the previously accumulated enors for 
15 magpnta (me) and cyan (ce), respectively. The processing then flows to step 64 in Fig. 1 0. 
As shown in Fig. 10, a modified input sum (m+c)' is generated in step 64. The 
modified input sum (m+c)' is equal to the original input sum (m+c) minus the product of 
the value of the fired flag and 255. Thus, if either cyan or magenta were printed in steps 
60 or 62, the fired flag is 1 and the modified input sum (m+c)' is equal to the original input 
20 sum (m+c) minus 255, otherwise the modified input sum (m+c)' is equal to the origmal 
input sum (m+c). Consequently, whether a dot has already been printed or not, the 
modified input sum (m+c)' will range from 0 to 255. 

The modified input sum (m+c)' is used to collect five values from a tone dependent 
look-up table in step 64, The tone dependent look-up table provides a tone dependent 
25 threshold level and four tone dependent error weights (Wl , W2, W3, and W4), which are 
to be used later in the error dispersion described in more detail below. 

In step 66 the threshold level is modified if the fired flag is equal to 1, i.e„ either 
cyan or magenta dots were printed in steps 60 or 62, to make it more difficult to print 
another dot for the pixel. The threshold level is modified by increasing the threshold level 
30 by a predetermined number, e.g., 80, which was determined empirically. Of course, if 
desired, the threshold level need not be modified or may be modified by other 
predetermiiKd amounts, or by a variable amount that is dependent on such factors as the 
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size of the modified input sum (m+c)' and/or the size of accumulated errors ce' and me', 
as well as any other useful factor. 

The tone levels and the modified accumulated errors for the plane dependent colors 
cyan and magenta are summed together to produce a modified total value sum 
5 (c+ce'+m+me') in step 68. In step 70, the modified total value sum (c+ce'+m+me') is 
compared to the tone dependent threshold level. If the modified total value sum 
(c+ce'+m+me') is less than the threshold level, no dot is printed at this point in the process 
and the process flovy^s to error disbursement in step 72. If, however, the modified total 
value sum (c+ce'+m+rae') is greater than the threshold level, a decision is made to print a 
10 dot and the process flows to step 76. 

In step 76, the modified total value for cyan (c+ce'), which is the tone level of cyan 
plus the modified accumulated error for cyan, is compared to the modified total value for 
magenta (ro+me'), which is the tone level for magenta plus the modified accumulated error 
for magenta. If the modified total value for cyan (c+ce') is greater than or equal to the 
1 5 modified total value for magenta (m+me'), a cyan dot is printed in step 78, otherwise, a 
magenta dot is printed in step 80. As shown in step 78, because a cyan dot is printed, the 
cyan accumulated error is again modified to produce a final dispersion enor for cyan (ce") 
that is equal to the previous modified accumulated error (ce') plus the input tone (c) for 
cyan minus 255. The final dispersion error for magenta (me") is equal to the previous 
20 modified accumulated error (me') plus the input tone (m) for magenta. In step 80, because 
a magenta dot is printed, the final dispersion error for magenta (me") is generated as equal 
to the previous modified magenta error (me') plus the input tone (m) minus 255, while the 
final dispersion error for cyan (ce") is equal to the previous modified error (ce') plus the 
input tone (c). The process then difiuses the final dispersion errors in step 72. 
25 Thus, a decision to print a dot is made at step 56 based on whether the tone level of 

the plane dependent colors is above a 100 percent fill threshold. After appropriately 
modifying the sum of the tones of the plane dependent colors, based on whether a dot of 
either color had been printed, a tone dependent threshold level is determined based on the 
modified input sum. Another decision to print a dot is made at stuap 70 based on whether 
30 the tone level of the plane dependent colors plus their accumulated errors is greater than 
the tone dependent threshold. Thus, steps 56 and 70 may decide to produce no dots, one 
dot, or two dots. 
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If two dots are printed, the same color will not be printed twice, because of the 
modification of the accumulated errors for magenta and cyan in steps 60 or 62. Thus, a 
magenta dot may be printed in step 62 foUowed by a cyan dot in step 78, or a cyan dot at 
step 60 followed by a magenta dot in step 80, but two cyan dots or two magenta dots will 
5 not be printed in the present embodiment. Overlapping cyan and magenta dots produce a 
dark blue dot, which may be appropriate when the intensity at a particular pixel is high. It 
should be understood that while the two dots are described as overlapping, it is possible 
that the dots will not completely overiap due to the continuous scanning of the print 
cartridges. 

10 If, in step 70, the modified total value sum (c+ce'+m+me') is less than the 

threshold level, a dot is not printed at this pomt in the process. Thus, the pixel may be 
represented with no dots or only one dot if a dot was printed in steps 60 or 62, i.e., the 
pixel is 100 percent fiilL Because a dot has not been printed, in step 81 the values of the 
final dispersion errors for cyan (ce^') and magenta (me") are defined as equal to the 

15 modified accumulated errors plus the input tones for cyan (ce'+c) and magenta (me'+m), 
respectively. The process tfien flows to step 72. 

In step 72, the final dispersion errors for cyan (ce'*) and magenta (me'O from steps 
78, 80, or 8 1 are multiplied by the values of the tone dependent error weightings Wl . W2, 
W3, and W4 determined in step 64. The weighted errors for cyan and magenta are then 

20 difiiised to nearby pixels as shown in Fig. 11. 

In accordance with one embodiment of the present invention, a four-term error 
diffusion is used, as shown in Fig. 1 1 , Thus, the final dispersion error derived from the 
current pixel being processed (e.g., pixel 94) is diffiised to the subsequent horizontal pixel 
95 and to the pixels in the next row, i.e., pixels 96, 97, and 98. The proportion of the error 

25 diffiised to each of these adjacent pixels is determined using the tone dependent error 

weightings Wl, W2, W3, and W4. The determination of zero, one, or two dots are printed 
for the subsequent pixel positions 95 to 98 will then be based on the desired tone levels for 
those pixels and the dispersion errors from pixel 94 and any accumulated dispersion errors 
from other pbtels. 

30 In the preferred embodiment, after each row of the image is processed, the 

direction of processing is reversed such that the error diffusion technique uses a serpentine 
processing system. Accordingly, the mirror image of Fig. 1 1 is used when the direction of 



?MS,m\m AT m05 5:12:42 PM [Eastern Standard Time] * SVR:USPTMFXRF-1I4 ' DNIS:8729306 ' CSID:858 655 5859 * DURATION (mnws):10-22 



FEB-04-2005 14:22 FROM HP SAN DIEGO LEGPL TO PTOCENTRftL P. 29/41 

processing i$ reversed. A two pass serpentine processing system or a non-serpentine 
processing system may also be used, if desired. 

The detennination for printing a yellow dot may be performed in parallel with the 
steps for printing the cyan and magenta dots. Correlating the yellow plane with the cyan 

5 and magenta planes provides little benefit because the cyan and magenta dots are darker 
than the yellow dots. The determination for printing a yellow dot uses the error diffusion 
technique described wiA respect to Fig, 1 1 and includes the steps shown in Fig, 9 as steps 
84, 86, 88, 90, and 92. Black likewise may be halftoned separately ftom cyan and magenta 
where the black dot is a different site than that of the cyan or magenta dots. The same 

10 tone dependent table used in step 64 may be used independently on the yellow plane (at 
stage 84) or on a black plane by substituting the single values of the yellow or black plane 
for the modified input sum (m+c)'. If desired, the yellow plane and/or the black plane may 
be correlated with cyan and magenta planes by scaling the method described in Figs. 9 and 
10, for example, in products that use a black dot that is the same size as the cyan and 

15 magenta dots* 

In pseudo-code, the tone dependent plane dependent error diffusion halftoning 
method is as follows: 

m= current input value for magenta 
20 c=^ current input value for cyan 

c_total= c + accumulated error for cyan; 
m_total= m + accumulated error for magenta; 
Input_sum - m + c: 
Fired = 0; 

25 

if (Input_sum >= 255.0) { //check the sum, if it is above 255 fire something! 



30 Fired = 1 ; 

if (m_total > c_total) 
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Fire magenta dot 
m_total = mjtotal -255; 

5 > 

else 
( 

Fire a Cyan dot 
10 cjotal = c_towl - 255; 

> 

} /// end suiii> 255 

// al this point you may have fired one dot 

Input_sum»Input-sum - (FIRED*255);// if you have fired a dot, modify your sum 
Thresholdjevel ^ Tpnput_sum] [0]; // use die tone dependent table 
Weightl =t[Input_sum] [1]; 
Weight2 =t(Input_sum] [2] 
20 Weights =t[lnput_suml[31 

Weight4 -t|Tnput_sum] [4] 

if (fired) // if you already fired, make it harder to fire again 
{ 

25 

Thresholdjevel = ThresholdJevel+80; 

} 

30 fired - 0; 

modified_siini= cjtoud+m_total; 
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if (Threshold_level< Modificd_sum // check to see which plane has the highest 
value and fire it 
( 

if (m_totaI>c_total) 
5 Fire Magenta; 

Else 

Fire Cyan; 



Calctilale Error for Magenta and distribute using Wl, W2, W3, W4 
Calculate Error for Cyan and distribute using Wl , W2, W3, W4 



Using the above error diffusion process combines plane dependency with tone 
dependency to create a color error dif5ftasion halftoning method that produces images with 
15 superior dot placement and uniform patterning. 

In another embodiment of the present invention, the plane dependent tone 
dependent error diffusion halftoning method includes the use of a prerendered bitmap for 
the mid-tones, i.e., approximately 50 percent tones. Error diffusion sometimes generates 
structured patterns in the image in the mid-tones. The prerendered 50 percent bitmap is 
20 used to break up visual artifacts in the mid-tones. 

To employ the prerendered SO percent bitm^, the error diffusion process 
determines if the modified total value sura (c-hce'+m+me') falls within a mid-tone range, 
and if so a bitmap is employed to decide whether to print a dot. The position of the pixel 
is compared to the bitmap, and if the bitmap has a value of 1, a dot is printed, otherwise 
25 the dot is not printed. If the modified total value sum (c+ce'-Hn+me') is greater than the 
mid-tone range, a dot is printed and if the modified total value sum (c+ce'+m+rae') is Jess 
than the raid-tone range, a dot is not printed. 

The plane dependent tone dependent error diffusion process with the use of a 
prerendered 50 percent bitmap is shown in Fig, 12. Fig. 12 follows Fig. 9, and is similar to 
30 Fig. 10, like designated steps being the same. 

As shown in Fig. 12, a modified input sum (m+c)' is generated in step 65 in the 
same maimer as step 64, shown in Fig, 1 0. The modified input sum (m+c)' is then used to 
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collect six values from a tone dependent look-up table. The tone dependent look-up table 
provides two threshold levels, a low threshold (thresholdjow) and a high threshold 
(threshold_high), and the four error weights (Wl, W2, W3, and W4). 

An example of a tone dependent threshold look-up table is attached hereto as 
5 Appendix A, where the tone level is the "gray" l^^^l' upper threshold is "t„" and the 
lower threshold is "t,". The tone dependent threshold look-up table of Appendix A may be 
used to provide a single threshold level, as discussed in reference to Fig. 1 0, by using, for 
example, either the upper threshold, the lower threshold, or the average of the upper and 
lower thresholds. 

A tone dependent error weighting look-up table is attached hereto as Appendix B, 
where the tone level is the "gray" level, w[0,13 represents pixel 95 in Fig. 1 1, w[l-l] 
represents pixel 98 in Fig. 1 1, w[1.01 represents pixel 97 in Fig. 1 1, and w[l.l] represents 
pixel 96 in Fig. 11. It should be understood, of course that the tone dependent threshold 
look-up table of Appendix A and the tone dependent error weighting table of Appendix B 
1 5 may be combined into one table. 

In step 67, both the low and high threshold levels are modified if the fired flag is 
equal to 1 , similar to &sp 66 shown in Fig. 1 0. 

The modified total value sum (c+ce'+m+me') is generated in step 68 and in step 
7 1 , the modified total value sum (c+ce'+m+me') is compared to the low threshold. If the 
modified total value sura (c+ce'+m+me') is less than the low threshold, no dots are printed 
and the process flows to error disbursement in step 72 via step 81 . If, however, the 
modified total value sum (cH-ce'+m+me') is greater than the low threshold, the modified 
total value sum (c+ce'+mrtne') is compared to the high threshold in step 74. If the 
modified total value sum (c+cc'+m+me*) is greater than the high threshold, the process 
25 goes to step 76, which is described above in reference to Fig. 10. 

If. in step 74. the modified total value sum (c+ce'+m+me') is not greater than the 
high threshold, and, thus, the modified total value sum (c+ce'+m+me') is in a mid tone 
range, i.e., between the low threshold and the high threshold, step 82 uses a preicndered 
mid-tone bitmap to determine if a dot should be printed. If the bitmap has a value of 1 at 
30 the pixel location a dot is printed and step 76 is used to determine whether to print a cyan 
or magenta dot. On the other hand, if at the pixel location the value of the bitmap is 0, no 
dot is printed and fte process then flows to step 72. 



20 
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The printed image of a useful prerendered mid-lone bitmap is shown as Fig. 13. 
The bitmap of Fig. 13 was generated using a direct binar>' search method as is well known 
to those of ordinary skill in the art. The bitmap shown in Fig. 1 3 may be tiled as necessary 
to cover the entire image being printed. Of course, if desired, prerendered mid^one 
5 bitmaps other than the one shown in Fig, 1 3 may be used. In addition, if desired, a 

screening processes using a predetennined matrix of threshold values may be used instead 
of the prerendered mid-tone bitmap. Screening is well known to those of ordinary skill in 
the ait. 

Thus, steps 71 and 74 determine if the modified total value sum (c-fce'+m+me') 
1 0 falls within the mid-tone range, i.e., between the low and high thresholds, or above or 
below that range. While Fig. 1 2 shows this process occurring in two steps, i.e., steps 71 
and 74, it should be understood that this deteraiination may be done in one step and/or in 
any order. 

In pseudo-code, the above process is as follows: 

15 

m= current input value for magenta 
c= current input value for cyan 
c total= c + accumulated error for cyan; 
m_total= m + accumulated error for magenta; 
20 Input^sum = m + c: 
Fired « 0; 

if (Input^sum >^ 255.0) { //check the sum. If it is above 255 fire something! 
Fired ^1; 
25 if (ra jotal > c Jotal) 

{ 

Fire magenta dot 
m_total = m_total *255; 

30 

} 

else 
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Fire a Cyan dot 
c_total '- c_total - 255; 

} 

} /// end sum> 255 

// at this point you may have fired one dot 

lnput,sum=Input-sum - (FIRED*255);// if you have fired a dot, modify your sum 
Threshold Jow = t[Input_*um] [OJ; // use the tone dependent table 
Tbresholdjiigh =t[lnput_sum] [1]; 
Weigbtl =t[Input_suinl[2l; 
Weight2 =t[Input_sum][3]; 
15 Weights =tpnput_sum][4]; 

Weight4 =t[Input_sum][5]; 

if (fired) // if you already fired, make it harder to fire again 
{ 

20 

Thiesholdjow = Threshold Jow+80; 
Thresholdjiigh ~ Threshold__high+80; 

} 

25 fired «= 0; 

modified_suin= c_total+m_total; 

if CThresholdJow< Modified_suin < Thresholdjiigh) // use bitmap 
{ 



3D 



if (mid_tone_bitmap[at current location} — 1) 
fired =1; 

) 
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else if (sum > Tl) 
fired -1; 

if (fired) // check to sec which plane has the highest value and fire it 
5 { 

if(m_total>c_total) 
Fire Magenta; 

Else 

Fire Cyan; 

10 } 

Calculate Error for Magenta and distribute using WI , W2, W3, W4 
Calculate Error for Cyan and distribute using Wl , W2, W3, W4 



IS 



to< 



It should be understood that while the present invention is described with reference 
cyan, magenta and yellow, the present invention may use any number or color of inks. 
Thus, the tone to be reproduced may be created by a combination of additional planes such 
as light cyan, light magenta, dark cyan, and dark magenta, in addition to medium cyan and 
medium magente. Some printers use the color planes cyan, magenta, yellow, orange, 
20 green, and black. The invention may be applied to a combination of all of these planes to 
reduce the likelihood that adjacent dots within a group of colors are printed and to help 
eliminate structured patterns. 

In a preferred embodiment, the look-up tables and method for controlling the error 
diffusion process are provided on a computer readable medium, such as a microdiskene or 
25 floppy diskette as a printer driver. This printer driver is then installed into the computer, 
such as computer 22 in Fig. 4, so that the program is installed in the computer's RAM- 
Such a program may be also installed in the printer and, in one embodiment, installed In 
firmware v>rithin the printer. This program would depend on the print mode or printiiead 
parameters as well as other factors. All logic functions may be implemented in hardware 
30 or software. If hardware is used, the various table values would be available to the 

circuitry implementing the halftone method via bus lines. The method may also be earned 
out by an ASIC, which controls the timing and transfer of data to the various logic devices 
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and look-up tables as well as to and from the Image map, as would be understood by those 
skilled in the art after reading this disclosure. 

Fig 14 is an example of a light blue tone printed using a combination of cyan dots 
6 and magenta dots 4 in accordance to the present invention to obtain the benefits of plane 
5 dependency and the superior dot placement of the tone dependent parameters. 

While the preferred embodiment requires an extra look-up table and a few more 
operations, making it slightly more computationally complex than previous halftoning 
n^ethods, the overall performance is only slightly slower than other error diffusion methods 
for halftoning. The benefit in the superior dot distribution is woUh the added complexity. 

While particular embodiments of the present invention have been shown and 
described, it will be obvious to those skilled in the art that changes and modifications may 
be made ^thout departing from this invention in its broader aspects and, therefore, the 
upended claims are to encompass within their scope all such changes and modifications 
as faU within the true spfait and scope of this invention. 



10 
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CLAIMS 

1 . A method of error diffusion halftoning to print a color image, the method 
comprising: 

5 identifying the tones of a plurality of colors (50-52) in a pixel in the color image; 

combining the tones of the plurality of colors to produce an uiput sum (54); 
using the input sum to determine a threshold level (64); 
combining the tones of the plurality of colors \vith accumulated errors for the 
plurality of colors at the pixel to produce a total value sum (68); and 
1 0 comparing the total value sum with the threshold level (70) to determine whether to 

print a dot of one of the plurality of colors. 

2. The method of Claim 1, further comprising determining what color dot to print 
when the total value sum is greater than the threshold level, wherein determinmg what 

15 color dot to print comprises: 

summing the tone of a first color with the accumulated error for the first color to 
produce a first total value; 

summing the tone of a second color with the accumulated error for the second color 
to produce a second total value; 
20 comparing the first total value with the second total value to determine the color 

with the larger total value (76); and 

printing a dot of the color with the larger total value (78) and (80). 

3. The method of Claim 2, further comprising: 

25 using the input sum to determine at least two error weightings (64); 

generating final dispersion errors for each color based on the accumulated errors 
for each color and the color of the dot printed if any (78) and (80); and 

using the at least two error weightings to diffuse the final dispersions errors for 
each color (72), 

30 

4. The method of Claim 1 , further comprising: 
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comparing the input sum with a ftill intensity threshold for the pixel (56) to 
detemine whether to print a first dot of one of the plurality of colors. 

5. The method of Claim 4. wherein a first dot of one of the plurality of colors i$ 
5 printed when the input sum is greater than the M intensity threshold and the comparing 

the total value sum with the threshold level determines whether to prim a second dot of 
one of the plurality of colors. 

6. The method of Claim 5, further comprising determining what color first dot to 
10 print when the input sum is greater than the fiill intensity threshold, wherein detemiining 

what color first dot to prim comprises: 

summing the tone of a first color with the accumulated error for the first color to 

produce a first total value; 

summing the tone of a second color with the accumulated error for the second color 

1 5 to produce a second total value; 

comparing the first total value with the second total value to determine the color 

with the larger total value (58); and 

printing a first dot of the color with the larger total value (60). (62). 

20 7- The method ofCl^ 6, fiuther comprising: 

modifying the input sum by subtracting the full intensity threshold from the input 
sum to produce a modified input sum (64), wherein the modified input sum is used to 
determine the threshold level; 

generating modified accumulated error values for each color (60), (62) based on the 
25 accumulated errors for each color and the color of the first dot printed if any. wherein the 
tones of the plurality of colors are combined with the modified accumulated errors for the 
plurality of colors to produce the total value sum (68). 

8. The method of Claim 5, wherein the first dot is printed of one of the plurality of 
30 colors and the second dot is primed of another one of the plurality of colors, the first dot 
and the second dot are printed to at least partially overiap. 
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9. The method of Claim 7, funher comprising determining what color second dot 
to print v/hen the total value sum is greater than the threshold level, wherein detennining 
what color second dot to print comprises: 

summing the tone of the first color with the modified accumulated error for the 
5 first color to produce a first modified total value; 

summing the tone of the second color with the modified accumulated error for the 
second color to produce a second modified total value; 

comparing the fust modified total value with the second modified total value to 
determine the color with the larger total value (76); and 
10 printing the second of the color with the larger total value (78), (80). 

1 0. The method of Claim 9, further comprising: 

using the modified input sum to determine at least two error weightings (64); 
generating fmal dispersion errors for each color based on the modified accumulated 
15 errors and input tone for each color and the color of the second dot printed (78), (80); and 
using the at least two error weightings to diffuse the fmal dispersions errors for 
each color (72). 
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